Model Explainer

Feature Importances

Feature Importances

Model performance metrics

metric Score
accuracy 0.656
precision 0.665
recall 0.636
f1 0.651
roc_auc_score 0.715
pr_auc_score 0.71
log_loss 0.62

Confusion Matrix

How many false positives and false negatives?

Precision Plot

Does fraction positive increase with predicted probability?

Classification Plot

Distribution of labels above and below cutoff

ROC AUC Plot

Trade-off between False positives and false negatives

PR AUC Plot

Trade-off between Precision and Recall

Lift Curve

Performance how much better than random?

Cumulative Precision

Expected distribution for highest scores

Individual Predictions

Select Random Index

Selected index: 30280

Prediction

label probability logodds
On Time* 78.8 % 1.311
Not On Time 21.2 % -1.311

Contributions Plot

How has each feature contributed to the prediction?

Partial Dependence Plot

Contributions Table

How has each feature contributed to the prediction?
Reason Effect
Average of population -0.1
EXT_SOURCE_3 = 0.6701754827792886 -0.35
FLAG_EMP_PHONE = 0.0 -0.31
EXT_SOURCE_2 = 0.6814484197027727 -0.23
FLAG_OWN_CAR = 1.0 -0.2
CODE_GENDER = 0.0 -0.17
AMT_GOODS_PRICE = 0.059550561797752796 +0.04
Other features combined +0.0
Final prediction -1.31

What if...

Select Random Index

Selected index: 39728

Prediction

label probability logodds
On Time 28.0 % -0.946
Not On Time 72.0 % 0.946

Feature Input

Adjust the feature values to change the prediction

Contributions Plot

How has each feature contributed to the prediction?

Partial Dependence Plot

Contributions Table

How has each feature contributed to the prediction?
Reason Effect
Average of population -0.1
EXT_SOURCE_2 = 0.29796087289274387 +0.59
EXT_SOURCE_3 = 0.43036854428713633 +0.27
CODE_GENDER = 1.0 +0.31
FLAG_OWN_CAR = 1.0 -0.2
FLAG_EMP_PHONE = 1.0 +0.04
AMT_GOODS_PRICE = 0.09101123595505617 +0.02
Other features combined +0.0
Final prediction 0.95

Feature Dependence

Shap Summary

Ordering features by shap value

Shap Dependence

Relationship between feature value and SHAP value